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NATIONAL FOREWORD 

This Indian Standard ( Part 3 ) which is identical with ISO 5725-3 : 1994 'Accuracy ( trueness and 
precision ) of measurement methods and results — Part 3 : Intermediate measures of the precision of 
a standard measurement method* issued by the International Organization for Standardization ( ISO ) 
was adopted by the Bureau o'f Indian Standard on the recommendations of the Engineering Metrology 
Sectional Committee and approval of the Basic and Production Engineering Division Council. 

This standard specifies the four intermediate precision measures due to changes in observation conditions 
( time, calibration, equipments and operator ) within a laboratory. 

Many different factors may contribute to the variability of results from a measurement method including 
operator, equipment used, calibration of equipment, environment ( temperature, humidity air-pollution, 
etc ); batch of a reagent and time elapsed between measurements. 

The text of the ISO Standard has been approved as suitable for publication as an Indian Standard 
without deviations. In this adopted standard certain conventions are, however, not identical to those 
used in Indian Standards. Attention is particularly drawn to the following: 

a) Wherever the words 'International Standard' appear referring to this standard, they should be 
read as Mndian Standard*. 

b) Comma ( , ) has been used as a decimal marker in the International Standards, while in Indian 
Standards, the current practice is to use a point ( . ) as the decimal marker. 

In the adopted standard, reference appears to the following International Standards for which Indian 
Standards also exists. The corresponding Indian Standards which are to be substituted in their place 
are listed below along with their degree of equivalence for the editions indicated; 



International Standard 

ISO 5725-1 : 1 994 Accuracy 
( trueness and precision ) of 
measurement methods and 
results — Part 1 : General principles 
and definitions 



ISO 5725-2 : 
( trueness and 
measurement 
results — Part 2 : 



1994 Accuracy 

precision ) of 

methods and 

Basic method for 



the determination of repeatability 
and reproducibility of a standard 
measurement method 



Corresponding Indian Standard 

IS 15393 ( Part 1 ) : 2003 Accuracy 
( trueness and precision ) of 
measurement methods and 
results : Part 1 General principles 
and definitions 

IS 15393 ( Part 2 ) : 2003 Accuracy 
( trueness and precision ) of 
measurement methods and 
results : Part 2 Basic method for tKe 
determination of repeatability and 
reproducibility of a standard 
measurement method 



Degree of Equivalence 
Identical 



do 



This standard ( Part 3 ) covers the intermediate measures of the precision of a standard measurement 
method. The other five parts of the standard are listed belaw: 



IS No. 



Title 



IS 15393 (Parti ) : 2003/ Accuracy (trueness and precision) of measurement methods and 
ISO 5725-1 : 1994 results : Part 1 General principles and definitions 

IS 15393 ( Part 2 ) ; 2003/ Accuracy ( trueness and precision ) of measurement methods and 
ISO 5725-2 : 1994 results : Part 2 Basic method for the determination of repeatability and 

reproducibility of a standard measurement method 



( Continued on third cover ) 
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Introduction 

0.1 ISO 5725 uses two terms "trueness" and "precision" to describe 
the accuracy of a nneasurement method. "Trueness" refers to the close- 
ness of agreement between the average value of a large number of test 
results and the true or accepted reference value. "Precision" refers to the 
closeness of agreement between test results. 



0.2 General consideration of th^se quantities is given in ISO 5725-1 and 
so is not repeated here. It is stressed that ISO 5725-1 should be read in 
conjunction with all other parts of ISO 5725 because the underlying defi- 
nitions and general principles are given there. 



0.3 Many different factors (apart from variations between supposedly 
identical specimens) may contribute to the variability of results from a 
measurement method, including: 

a) the operator; 

b) the equipment used; 

c) the calibration of the equipment; 

d) the environment (temperature, humidity, air pollution, etc.); 

e) the batch of a reagent; 

f) the time elapsed between measurements. 

The variability between measurements performed by different operators 
and/or with different equipment will usually be greater than the variability 
between measurements carried out within a short interval of time by a 
single operator using the same equipment. 



0.4 Two conditions of precision, termed repeatability and reproducibility 
conditions, have been found necessary and, for many practical cases, 
useful for describing the variability of a measurement method. Under re- 
peatability conditions, factors a) to f) in 0.3 are considered constants and 
do not contribute to the variability, while under reproducibility conditions 
they vary and do contribute to the variability of the test results. Thus re- 
peatability and reproducibility conditions are the two extremes of pre- 
cision, the first describing the minimum and the second the maximum 
variability in results. Intermediate conditions between these two extreme 
conditions of precision are also conceivable, when one or more of factors 
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a) to f) are allowed to van/, and are used in certain specified circunn- 
stances. 

Precision is normally expressed in ternns of standard deviations. 

0.5 This part of ISO 5725 focuses on iaternnediate precision nneasures 
of a nneasurennent method. Such measures are called intermediate as 
their magnitude lies between the two extreme measures of the precision 
of a measurement method: repeatability and reproducibility standard de- 
viations. 

To illustrate the need for such intermediate precision measures, consider 
the operation of a present-day laboratory connected with a production 
plant involving, for exampfe, a three-shift working system where 
measurements are made by different operators on different equipment. 
Operators and equipment are then some of the factors that contribute to 
the variability in the test results. These factors need to be taken into ac- 
count when assessing the precision of the measurement rnethod. 

0.6 The intermediate precision measures defined in this part of 
ISO 5725 are primarily useful when their estimation is part of a procedure 
that aims at developing, standardizing, or controlling a measurement 
method within a laboratory. These measures can also be estimated in a 
specially designed interlaboratory study, but their interpretation and appli- 
cation then requires caution for reasons explained in 1.3 and 9.1. 

0.7 The four factors most likely to influence the precision of a 
measurement method are the following. 

a) Time: whether the time interval between successive measurements 
is short or long. 

b) Calibration: whether the same equipment is or is not recalibrated 
between successive groups of measurements. 

c) Operator: whether the same or different operators carry out the suc- 
cessive measurements. 

d) Equipment: whether the same or different equipment (or the same 
or different batches of reagents) is used in the measurements. 

0.8 It is, therefore, advantageous to introduce the following Af-factor- 
different intermediate precision conditions (A/= 1, 2, 3 or 4) to take ac- 
count of changes in measurement conditions (time, calibration, operator 
and equipment) within a laboratory. 

a) Af = 1 : only one of the four factors is different; 

b) Af == 2: two of the four factors are different; 

c) Af = 3: three of the four factors are different; 

d) A/ = 4: all four factors are different. 

Different intermediate precision conditions lead to different intermediate 
precision standard deviations denoted by s^^y where the specific con- 
ditions are listed within the parentheses. For example, s^^q^ is the inter- 
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mediate precision standard deviation with different times (T) and 
operators (0). 

0.9 For measurements under intermediate precision conditions, one or 
more of the factors listed in 0.7 is or are different. Under repeatability 
conditions, those factors are assumed to be constant. 

The standard deviation of test results obtained under repeatability con- 
ditions is generally less than that obtained under the conditions for inter- 
mediate precision conditions. Generally in chemical analysis, the standard 
deviation under intermediate precision conditions may be two or three 
times as large as that under repeatability conditions. It should not, of 
course, exceed the reproducibility standard deviation. 

As an example, in the determination of copper in copper ore, a 
collaborative experiment among 35 laboratories revealed that the standard 
deviation under one-factor-different intermediate precision conditions (op- 
erator and equipment the same but time different) was 1,5 times larger 
than that under repeatability conditions, both for the electrolytic gravimetry 
and NajSjOg titration methods. 



m 
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Indian Standard 

ACCURACY ( TRUENESS AND PRECISION ) OF 
MEASUREMENT METHODS AND RESULTS 

PART 3 INTERMEDIATE MEASURES OF THE PRECISION 
OF A STANDARD MEASUREMENT METHOD 



1 Scope 



the outcome of a calculation from a set of obser- 
vations. 



1.1 This part of ISO 5725 specifies four intermedi- 
ate precision measures due to changes in observation 
conditions (time, calibration, operator and equipment) 
within a laboratory. These intermediate measures can 
be established by an experiment within a specific 
laboratory or by an interlaboratory experiment. 

Furthermore, this part of ISO 5725 

a) discusses the implications of the definitions of in- 
termediate precision measures; 

b) presents guidance on the interpretation and appli- 
cation of the estimates of intermediate precision 
measures in practical situations; 

c) does not provide any measure of the errors in 
estimating intermediate precision measures; 

d) does not concern itself with determining the 
trueness of the measurement method itself, but 
does discuss the connections between trueness 
and measurement conditions. 



1.2 This part of ISO 5725 is concerned exclusively 
with measurement methods which yield measure- 
ments on a continuous scale and give a single value 
as the test result, although the single value may be 



1.3 The essence of the determination of these in- 
termediate precision measures is that they measure 
the ability of the measurement method to repeat test 
results under the defined conditions. 

1.4 The statistical methods developed in this part 
of ISO 5725 rely on the premise that one can pool 
information from "similar" measurement conditions 
to obtain more accurate information on the inter- 
mediate precision measures. Thrs premise is a 
powerful one as long as what is claimed as "similar" 
is indeed "similar". But it is very difficult for this 
premise to hold when intermediate precision meas- 
ures are estimated from an interlaboratory study. For 
example, controlling the effect of "time" or of "oper- 
ator" across laboratories in such a way that they are 
"similar", so that pooling information from different 
laboratories makes sense, is very difficult. Thus, using 
results from interlaboratory studies on intermediate 
precision measures requires caution. Within- 
laboratory studies also rely on this premise, but in 
such studies it is more likely to be realistic, because 
the control and knowledge of the actual effect of a 
factor is then more within reach of the analyst. 

1.5 There exist other techniques besides the ones 
described in this part of ISO 5725 to estimate and to 
verify intermediate precision measures within a lab- 
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oratory, for example, control charts (see ISO 5725-6). 
This part of ISO 5725 does not clainn to describe the 
only approach to the estimation of intermediate pre- 
cision measures within a specific laboratory. 

NOTE 1 This part of ISO 5725 refers to designs of ex- 
periments such as nested designs. Sonne basic information 
is given in annexes B and C. Other references in this area 
are given in annex E. 

2 Normative references 

The following standards contain provisions which, 
through reference in this text, constitute provisions 
of this part of ISO 5725. At the time of publication, the 
editions indicated were valid. All standards are subject 
to revision, and parties to agreements based on this 
part of ISO 5725 are encouraged to investigate the 
possibility of applying the most recent editions of the 
standards indicated below. Members of tEC and ISO 
maintain registers of currently valid International 
Standards. 

ISO 3534-1:1993, Statistics — Vocabulary and sym- 
bols — Part 1: Probability and general statistical 
ternns. 

ISO 5725-1:1994, Accuracy (trueness and precision) 
of measurennent methods and results — Part 1: 
General principles and definitions. 

ISO 5725-2:1994, Accuracy (trueness and precision) 
of measurement methods and results — Part 2: Basic 
method for the determination of repeatability and 
reproducibility of a standard measurement method. 

ISO Guide 33:1989, Uses of certified reference ma- 
terials. 

ISO Guide 35:1989, Certification of reference ma- 
terials — General and statistical principles. 



3 Definitions 

For the purposes of this part of ISO 5725, the defi- 
nitions given in ISO 3534-1 and ISO 5725-1 apply. 

The symbols used in ISO 5725 are given in annex A. 



4 General requirement 

In order that the measurements are made in the same 
way, the measurement method shall have been 
standardized. All measurements forming part of an 
experiment within a specific laboratory or of an inter- 
laboratory experiment shall be carried out according 
to that standard. 



5 important factors 



5-1 Four factors (time, calibration, operator and 
equipment) in the measurement conditions within a 
laboratory are considered to make the main contri- 
butions to the variability of measurements (see 
table 1). 



5.2 "Measurements made at the same time" in- 
clude those conducted in as short a time as feasible 
in order to minimize changes in conditions, such as 
environmental conditions, which cannot always be 
guaranteed constant. "Measurements made at differ- 
ent times", that is those carried out at long intervals 
of time, may include effects due to changes in en- 
vironmental conditions. 



Table 1 — Four important factors and their states 



Factor 


Measurement conditio 
State 1 (same) 


ns within a iaboratory 

state 2 (different) 


Time 


Measurements made at the same 


Measurements made at different 




time 


times 


Calibration 


No calibration between measure- 


Calibration carried out between 




ments 


measurements 


Operator 


Same operator 


Different operators 


Equipment 


Same equipment without recali- 
bration 


Different equipment 
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5,3 "Calibration" does not refer here to any cali- 
bration required as an integral part of obtaining a test 
result by the measurement method. It refers to the 
calibration process that takes place at regular intervals 
between groups of measurements within a labora- 
tory. 



5.4 In some operations, the "operator" may be, in 
fact, a team of operators, each of whom performs 
some specific part of the procedure. In such a case, 
the team should be regarded as the operator, and any 
change in membership or in the allotment of duties 
within the team should be regarded as providing a 
different "operator". 



— operator-different intermediate precision standard 
deviation, s^Qy 

— [time -f _operator]-different intermediate precision 
standard deviation, sifjoy 

— [time -h operator -h equipment]-different inter- 
mediate precision standard deviation, ^|(toe)' 

— and many others in a similar fashion. 



6 Statistical model 



5,5 "Equipment" is often, in fact, sets of equip- 
ment, and any change in any significant component 
should be regarded as providing different equipment. 
As to what constitutes a significant component, 
common sense must prevail. A change of 
thermometer would be considered a significant com- 
ponent, but using a slightly different vessel to contain 
a water bath would be considered trivial. A change of 
a batch of a reagent should be considered a significant 
component. It can lead to different "equipnnent" or to 
a recalibration if such a change is followed by cali- 
bration. 



5,6 Under repeatability conditions, all four factors 
are at state 1 of table 1 . For intermediate precision 
conditions, one or nrrore factors are at state 2 of 
table 1, and are specified as "precision conditions 
with M factor(s) different", where M is the number 
of factors at state 2. Under reproducibility conditions, 
results are obtained by different laboratories, so that 
not only are all four factors at state 2 but also there 
are additional effects due to the differences between 
laboratories in management and maintenance of the 
laboratories, general training levels of operators, and 
in stability and checking of test results, etc. 



5.7 Under intermediate precision conditions with M 
factor(s) different, it is necessary to specify which 
factors are at state 2 of table 1 by means of suffixes, 
for example: 

— time-different intermediate precision standard de- 
viation, S^^y 

— calibration-different intermediate precision stan- 



dard deviation, s, 



1(C)' 



6.1 Basic model 

For estimating the accuracy (trueness and precision) 
of a measurement method, it is useful to assume that 
every test result, 3^, is the sum of three components: 

y^m'^B-\-e ... (1) 

where, for the particular material tested, 

m is the general mean (expectation); 

B is the laboratory component of bias under re- 
peatability conditions; 

e is the random error occurring in every 
measurement under repeatability conditions. 

A discussion of each of these components, and of 
extensions of this basic model, follows. 



6.2 General mean, m 

6.2.1 The general mean, m, is the overall mean of 
the test results. The value of m obtained in a 
collaborative study (see ISO 5725-2) depends solely 
on the "true value" and the measurement method, 
and does not depend on the laboratory, equipment, 
operator or time by or at which any test result has 
been obtained. The general mean of the particular 
material measured is called the "level of the test"; for 
example, specimens of different purities of a chemical 
or different materials (e.g. different types of steel) will 
correspond'to different levels. 

In many situations, the concept of a true value ^ holds 
good, such as the true concentration of a solution 
which is being titrated. The level m is not usually equal 
to the true value //; the difference {m - ^) is called the 
"bias of the measurement method". 
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In some situations, the level of the test is exclusively 
defined by the measurennent nnethod, and the con- 
cept of an independent true value does not apply; for 
example, the Vicker's hardness of steel and the 
Micum indices of coke belong to this category. How- 
ever, in general, the bias is denoted by 6 (5 = where 
no true value exists), then the general mean m is 



^ + 6 



.(2) 



NOTE 2 Discussion of the bias term S and a description 
of trueness experinnents are given in ISO 5725-4. 



6.2,2 When examining the difference between test 
results obtained by the same measurement method, 
the bias of the measurement method may have no 
influence and can be ignored, unless it is a function 
of the level of the test. When comparing test results 
with a value specified in a contract, or a standard 
value where the contract or specification refers to the 
true value /i and not to the level of the test m, or when 
comparing test results obtained using different 
measurement methods, the bias of the measurement 
method must be taken into account. 



6.3 Term B 



6.3,1 5 is a term representing the deviation of a 
laboratory, for one or more reasons, from m, irre- 
spective of the random error e occurring in every test 
result. Under repeatability conditions in one labora- 
tory. B is considered constant and is called the "lab- 
oratory component of bias". 



6.3.2 However, when using a measurement method 
routinely, it is apparent that embodied within an 
overall value for B are a large number of effects which 
are due, for example, to changes in the operator, the 
ecjuipment used, the calibration of the equipment, and 
the environment (temperature, humidity, air pollution, 
etc.). The statistical model [equation (1)] can then be 
rewritten in the form: 



:/M+Bo + 5(1)-hB(2)-f 



+ e 



or 



>'=/l-h^-hBo + ^(1) + ^(2) + .- + e 



(3) 



(4) 



where B is composed of contributions from variates 



In practice, the objectives of a study and consider- 
ations of the sensitivity of the measurement method 
will govern the extent to which this model is used. In 
many cases, abbreviated forms will suffice. 



6.4 Terms Bq, Bh), Brnu etc. 



Bo.B 



(1) 



B^2) -"■ 3^d can account for a number of inter- 



mediate precision factors. 



C ^(1)' ^(2)' 



6.4.1 Under repeatability conditions, these terms all 
remain constant and add to the bias of the test re- 
sults. Under intermediate precision condition's, Bq is 
the fixed effect of the factor(s) that remained the 
same (state 1 of table 1), while B^^y B^2)' ®^c. are the 
random effects of the factor(s) which vary (state 2 of 
table 1). These no longer contribute to the bias, but 
increase the intermediate precision standard deviation 
so that it becomes larger than the repeatability stan- 
dard deviation. 



6.4,2 The effects due to differences between oper- 
ators include personal habits in operating measure- 
ment methods (e.g. in reading graduations on scales, 
etc.). Some of these differences should be removable 
by standardization of the measurement method, par- 
ticularly in having a clear and accurate description of 
the techniques involved. Even though there is a bias 
in the test results obtained by an individual operator, 
that bias is not always constant (e.g. the magnitude 
of the bias will change according to his/her mental 
and/or physical conditions on that day) and the bias 
cannot be corrected or calibrated exactly. The magni- 
tude of such a bias should be reduced by use of a 
clear operation manual and training. Under such cir- 
cumstances, the effect of changing operators can be 
considered to be of a random nature. 



6.4,3 The effects due to differences between 
equipment include the effects due to different places 
of installation, particularly in fluctuations of the indi- 
cator, etc. Some of the effects due to differences 
between equipment can be corrected by exact cali- 
bration. Differences due to systematic causes be- 
tween equipment should be corrected by calibration, 
and such a procedure should be included in the stan- 
dard method. For example, a change in the batch of 
a reagent could be treated that way. An accepted 
reference value is needed for this, for which 
ISO Guide 33 and ISO Guide 35 shall be consulted. 
The remaining effect due to equipment which has 
been calibrated using a reference nr>aterial is con- 
sidered a random effect. 
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6.4.4 The effects due to time may be caused by 
environmental differences, such as changes in room 
temperature, humidity, etc. Standardization of en- 
vironmental conditions should be attempted to mini- 
mize these effects. 



6.4.5 The effect of skill or fatigue of an operator may 
be considered to be the interaction of operator and 
time. The performance of a set of equipment may be 
different at the time of the start of its use and after 
using it for many hours: this is an example of inter- 
action of equipment and time. When the population 
of operators is small in number and the population of 
sets of equipment even smaller, effects caused by 
these factors may be evaluated as fixed (not random) 
effects. 



6.4.6 The procedures given in ISO 5725-2 are de- 
veloped assuming that the distribution of laboratory 
components of bias is approximately normal, but in 
practice they work for most distributions provided that 
these distributions are unimodal. The variance of B is 
called the "between-laboratory variance", expressed 
as 



Var(5) 



•-(5) 



However, it will also include effects of changes of 
operator, equipment, time and environment. From a 
precision experiment using different operators, 
measurement times, environments, etc., in a nested 
design, intermediate precision variances can be cal- 
culated. Var{B) is considered to be composed of in- 
dependent contributions of laboratory, operator, day 
of experiment, environment, etc. 



Var(5) = Var(5o) + Var(5(i)) -f Var(5(2)) + ... 



The variances are denoted by 



.(6) 



Var(5o) = 4) 
Var(5(ij)-a^i) 

Var(£f(2)) = <^%y etc. 



..(7) 



Var{B) is estimated in practical terms as s^ and similar 
intermediate precision estimates may be obtained 
from suitably designed experiments. 



6.5 Error term, e 

6.5.1 This term represents a random error occurring 
in every test result and the procedures given 
throughout this part of ISO 5725 were developed as- 
suming that the distribution of this error variable is 
approximately normal, but in practice they work for 
most distributions provided that they are unimodal. 



6.5.2 Within a single laboratory, its variance is called 
the within-laboratory variance and is expressed as 



Var(e)=(T$v 



(8) 



6.5.3 It may be expected that aw will have different 
values in different laboratories due to differences such 
as in the skills of the operators, but in this part of 
ISO 5725 it is assumed that, for a properly standard- 
ized measurement method, such differences be- 
tween laboratories should be small and that it is 
justifiable to establish a common value of within- 
laboratory variance for all the laboratories using the 
measurement method. This common value, which is 
estimated by the mean of the within-laboratory vari- 
ances, is called the "repeatability variance" and is 
designated by 



<j; = VarW 



..(9) 



This mean value is taken over all the laboratories tak- 
ing part in the accuracy experiment which remain af- 
ter outliers have been excluded. 



7 Choice of measurement conditions 

7.1 In applying a measurement method, many 
measurement conditions are conceivable within a 
laboratory, as follows: 

a) repeatability conditions (four factors constant); 

b) several intermediate precision conditions with one 
factor different; 

c) several intermediate precision conditions with two 
factors different; 

d) several intermediate precision conditions with 
three factors different; 

e) intermediate precision conditions with four factors 
different. 

In the standard for a measurement method, it is not 
necessary (or even feasible) to state all possible pre- 
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cision measures, although the repeatability standard 
deviation should always be specified. As regards in- 
termediate precision measures, common commercial 
practice should indicate the conditions normally en- 
countered, and it should be sufficient to specify only 
the one suitable intermediate precision measure, to- 
gether with the detailed stipulation of the specific 
measurement conditions associated with it. The 
measurement condition factor(s) to be changed 
should be carefully defined; in particular, for time- 
different intermediate precision, a practical mean time 
interval between successive measurements should 
be specified. 



7.2 It is assumed that a standardized measurement 
method will be biased as little as possible, and that 
the bias inherent in the method itself should have 
been dealt with by technical means. This part of 
ISO 5725, therefore, deals only with the bias coming 
from the measurement conditions. 



7.3 A change in the factors of the measurement 
conditions {time, calibration, operator and equipment) 
from repeatability conditions (i.e. from state 1 to 2 of 
table 1) will increase the variability of test results. 
However, the expectation of the mean of a number 
of test results will be less biased than under repeat- 
ability conditions. The increase in the standard devi- 
ation for the intermediate precision conditions may be 
overcome by not relying on a single test result but by 
using the mean of several test results as the final 
quoted result. 



7.4 Practical considerations in most laboratories, 
such as the desired precision (standard deviation) of 
the final quoted result and the cost of performing the 
measurements, will govern the number of factors and 
the choice of the factor(s) whose changes can be 
studied in the standardization of the measurement 
method. 



8 Within-laboratory study and analysis 
of intermediate precision measures 



of factor(s) between each measurement. It is rec- 
ommended that n should b§ at least 15. This may not 
be satisfactory for the laboratory, and this method of 
estimating intermediate precision measures within a 
labor^ory cannot be regarded as efficient when 
compared with other procedures. The analysis is 
simple, however, and it can be useful for studying 
time-different intermediate precision by making suc- 
cessive measurements on the same sample on suc- 
cessive days, or for studymg the effects of calibration 
between measurements. 

A graph of (y/c~y) versus the measurement number 
k, where y,, is the k^^ test result of n replicate test re- 
sults and y is the mean of the n replicate test results, 
is recommended to identify potential outliers. A more 
formal test of outliers consists of the application of 
Grubbs' test as given in subclause 7.3.4 of 
150 5725-2:1994. 

The estimate of the intermediate precision standard 
deviation with M factor(s) different is given by 



"^'0 






--(10) 



where symbols denoting the intermediate precision 
conditions should appear inside the parentheses. 



8.2 An alternative method 

8.2.1 An alternative method considers t groups of 
measurements, each comprising n replicate test re- 
sults. For example, within one laboratory, a set of t 
materials could each be measured, then the inter- 
mediate precision factor(s) could be altered and the t 
materials remeasured, the procedure being repeated 
until there are n test results on each of the t materials. 
Each group of n test results shall be obtained on one 
identical sample (or set of presumed identical samples 
in the case of destructive testing), but it is not es- 
sential that the materials be identical. It is only re- 
quired that the t materials all belong to the interval of 
test levels within which one value of the intermediate 
precision standard deviation with M factor(s) different 
can be considered to apply. It is recommended that 
the value of t{n~^) should be at least 15. 



8.1 Simplest approach 

The simplest method of estimating an intermediate 
precision standard deviation within one laboratory 
consists of taking one sample (or, for destructive 
testing, one set of presumably identical samples) and 
performing a series of n measurements with a change 



EXAMPLE 

One operator performs a single measurement on 
each of the t materials, then this is repeated by a 
second operator, and possibly by a third operator, and 
so on, allowing an estimate of 5|(o) to be calculated. 
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8.2.2 A graph of (y.jt - y) versus the material number 
;, where yjt, is the k test result on the/*" material and 
yj is the average of the n results on the/^ material, is 
recommended to identify potential outliers. A more 
formal test of outliers consists of the application of 
Grubbs' test as given in subclause 7.3.4 of 
ISO 5725-2:1994 either for each group separately or 
for all tn test results combined. 

The estimate of the intermediate precision standard 
deviation with M factor(s) different, s^^y is then given 

by 



^v,() = 



K^I^S*^''-''' 



.(11) 



For rt = 2 (i.e. two test results on each material), the 
formula simplifies to 



-^10 



iiZ^yn-yj^r 



.-.(12) 



8.3 Effect of the measurement conditions on 
the final quoted result 

8.3.1 The expectation of y is different between one 
combination and another of time, calibration, operator 
and equipment, even when only one of the four fac- 
tors changes. This is a limitation on the usefulness of 
mean values. In chemical analysis or physical testing, 
y is reported as the final quoted result. In trading raw 
materials, this final quoted result is often used for 
quality evaluation of the raw nnateriais and affects the 
price of the product to a considerable extent. 

EXAMPLE 

In the international trading of coal, the size of the 
consignment can often exceed 70 000 t, and the ash 
content is determined finally on a test portion of only 
1 g. In a contract stipulating that each difference of 
1 % in ash content corresponds to USD 1,5 per tonne 
of coal, a difference of 1 mg in the weighing of ash 
by a chemical balance corresponds to 0,1 % in ash 
content, or USD 0,15 per tonne, which for such a 
consignment amounts to a difference in proceeds of 
USD 10 500 (from 0,1 x 1,5 x 70 000). 



8.3.2 Consequently, the final quoted result of 
chemical analysis or physical testing should be suf- 
ficiently precise, highly reliable and, especially, uni- 
versal and reproducible. A final quoted result which 



can be guaranteed only under conditions of a specific 
operator, equipment or time may not be good enough 
for commercial considerations. 



9 Interlaboratory study and analysis of 
intermediate precision measures 

9.1 Underlying assumptions 

Estimation of intermediate measures of precision 
from interlaboratory studies relies on the assumption 
that the effect of a particular factor is the same across 
all laboratories, so that, for example, changing oper- 
ators in one laboratory has the same effect as chang- 
ing operators in another laboratory, or that variation 
due to time is the same across all laboratories. If this 
assumption is violated, then the concept of inter- 
mediate measures of precision does not make sense, 
nor do the techniques proposed in the subsequent 
sections to estimate these intermediate measures of 
precision. Careful attention to outliers (not necessarily 
deletion of outliers) must be paid as this will help in 
detecting departure from the assumptions necessary 
to pool information from^ll laboratories. One powerful 
technique to detect potential outliers is to depict the 
measurements graphically as a function of the various 
levels of the factors or the various laboratories in- 
cluded in the study. 



9.2 Simplest approach 

If material at q levels is sent to p laboratories who 
each perform measurements on each of the q levels 
with a change of intermediate precision factor{s) be- 
tween each of the n measurements, then the analysis 
is by the same method of calculation as explained in 
ISO 5725-2, except that an intermediate precision 
standard deviation is estimated instead of the repeat- 
ability standard deviation. 



9.3 Nested experiments 

A further way of estimating intermediate precision 
measures is to conduct more sophisticated exper- 
iments. These can be fully-aested or staggered- 
nested experiments (for definitions of these terms, 
see ISO 3534-3). The advantage of employing a 
nested experimental design is that it is possible, at 
one time and in one interlaboratory experiment, to 
estimate not only repeatability and reproducibility 
standard deviations but also one or more intermediate 
precision standard deviations. There are, however, 
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certain caveats which must be considered, as will be 
explained in 9.8. 



9.4 FuHy-nested experiment 

A schematic layout of the fully-nested experiment at 
a particular level of the test is given in figure 1 . 

By carrying out the three-factor fully-nested exper- 
iment collaboratively in several laboratories, one in- 
termediate precision measure can be obtained at the 
same time as the repeatability and reproducibility 
standard deviations, i.e. a^Qy a^j and a^ can be esti- 
mated. Likewise the four-factor fuliy-nested exper- 
iment can be used to obtain two intermediate 
precision measures, i.e. c7(o), cr^^), cr(2) srid a^ can be 
estimated. 



The subscripts i, j and k suffixed to the data y in 
figure 1 a) for the three-factor fully-nested experiment 
represent, for example, a laboratory, a day of exper- 
iment and a replication under repeatability conditions, 
respectively. 

The subscripts /, / k and / suffixed to the data y in 
figure 1 b) for the four-factor fully-nested experiment 
represent, for example, a laboratory, a day of exper- 
iment, an operator and a replication under repeatability 
conditions, respectively. 

Analysis of the results of an n-factor fully-nested ex- 
periment is carried out by the statistical technique 
"analysis of variance" (ANOVA) separately for each 
level of the test, and is described in detail in 
annex B. 



FACTOR 

(laboratory) 

1 y — 

2 (residual) k — 



/hi //21 

g) Three-factor fuUy-nested experiment 



y/22 



FACTOR 

(laboratory) 
1 

2 k — 

1 (residual) i — 

yijki 



J — 



y/111 



//112 



//121 y/122 y/211 

b) Four-factor fully-nested experiment 



//212 



y/221 



y/222 



Rgure 1 — Schematic layouts for three-factor and four-factor fully-nested experiments 
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9.5 Staggered-nested experiment 

A schematic layout of the staggered-nested exper- 
iment at a particular level of the test is given in 

figure 2. 



FACTOR 

(Laboratory) 

1 

2 

3 (residual) J — 



yu 



Yn 



y-a Yi^ yik 



Figure 2 — Schematic layout of a four-factor 
staggered-nested experiment 



The three-factor staggered-nested experiment re- 
quires each laboratory / to obtain three test results. 
Test results y-^y and y^2 shall be obtained under re- 
peatability conditions, and ^^3 under intermediate pre- 
cision conditions with M factor(s) different 
(M= 1. 2 or 3), for example under time-different in- 
termediate precision conditions (by obtaining >?,3 on a 
different day from that on which y-^-^ and y^^ were ob- 
tained). 

In a four-factor staggered-nested experiment y,4 shall 
be obtained under intermediate precision conditions 
with one more factor different, for example, under 
[time + operator]-different intermediate precision 
conditions by changing the day and the operator. 

Again, analysis of the results of an /z-factor 
staggered-nested experiment is carried out by the 
statistical technique "analysis of variance" (ANOVA) 
separately for each level of the test, and is described 
in detail in annex C. 

9.6 Allocation of factors in a nested 
experimental design 

The allocation of the factors in a nested experimental 
design is arranged so that the factors affected most 
by systematic effects should be in the highest ranks 
(0, 1 , ...), and those affected most by random effects 



should be in the lowest ranks, the lowest factor being 
considered as a residual variation. For example, in a 
four-factor design such as illustrated in figure 1 b and 
figure 2, factor could be the laboratory, factor 1 the 
operator, factor 2 the day on which the measurement 
is carried out, and factor 3 the replication. This may 
not seem important in the case of the fully-nested 
experiment due to its symmetry, 

9.7 Comparison of the nested design with 
the procedure given in ISO 5725-2 

The procedure given in ISO 5725-2, because the 
analysis is carried out separately for each level of the 
test (material), is, in fact, a two-factor fully-nested ex- 
perimental design and produces two standard devi- 
ations, the repeatability and reproducibility standard 
deviations. Factor is the laboratory and factor 1 the 
replication. If this design were increased by one fac- 
tor, by having two operators in each laboratory each 
obtaining two test results under repeatability con- 
ditions, then, in addition to the repeatability and 
reproducibility standard deviations, one could deter- 
mine the operator-different intermediate precision 
standard deviation. Alternatively, if each laboratory 
used only one operator but repeated the experiment 
on another day, the time-different intermediate pre- 
cision standard deviation would be determined by this 
three-factor fully-nested experiment. The addition of 
a further factor to the experiment, by each laboratory 
having two operators each carrying out two 
measurements and the whole experiment being re- 
peated the next day, would allow determination of the 
repeatability, reproducibility, operator-different, time- 
different, and [time -h operator]-different standard 
deviations. 

9.8 Comparison of fuiiy-nested and 
staggered-nested experimental designs 

An n-f actor fully-nested experiment requires 2"" ^ test 
results from each laboratory, which can be an ex- 
cessive requirement on the'^laboratories. This is the 
main argument for the staggered-nested experimental 
design. This design requires less test results to pro- 
duce the same number of standard deviations, al- 
though the analysis is slightly more complex and there 
is a larger uncertainty in the estimates of the standard 
deviations due to the smaller number of test results. 
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Annex A 

(normative) 

Symbols and abbreviations used in ISO 5725 



'0). 



B(2), etc. 



C, C. C" 



C C C" 



CDp 



CRp 



/ 

G 

h 



Intercept in the relationship 
s — a Srbm 

Factor used to calculate the uncer- 
tainty of an estimate 

Slope in the relationship 
s = a-Vbm 

Component in a test result rep- 
resenting the deviation of a labora- 
tory from the general average 
(laboratory component of bias) 

Component of B representing all 
factors that do not change in inter- 
mediate precision conditions 

Components of B representing fac- 
tors that vary in intermediate pre- 
cision conditions 

Intercept in the relationship 
Ig ^ = c -h d Ig m 

Test statistics 

Critical values for statistical tests 

Critical difference for probability F 

Critical range for probability F 

Slope in the relationship 
Ig 5 = c -h <i Ig m 

Component in a test result rep- 
resenting the random error occur- 
ring in every test result 

Critical range factor 

p-quantile of the F-distribution with 
vt and V2 degrees of freedom 

Grubbs' test statistic 

Mandel's between-laboratory con- 
sistency test statistic 



k Mandel's within-laboratory consistency test sta- 
tistic 

LCL Lower control limit (either action limit or warning 
limit) 

m General mean of the test property; level 

M Number of factors considered in intermediate 
precision conditions 

A^ Number of iterations 

n Number of test results obtained in one labora- 
tory at one level (i.e. per cell) 

p Number of laboratories participating in the inter- 
laboratory experiment 

F Probability 

q Number of levels of the test property in the 
interlaboratory experiment 

r Repeatability limit 

R Reproducibility limit 

RM Reference material 

5 Estimate of a standard deviation 

s Predicted standard deviation 

T Total or sum of some expression 

/ Number of test objects or groups 

UCL Upper control limit (either action limit or warning 
limit) 

W Weighting factor used in calculating a weighted 
regression 

w Range of a set of test results 

X Datum used for Grubbs' test 

y Test result 
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y Arithmetic mean of test results 

V Grand mean of test results 
a Significance level 

P Type II error probability 

y Ratio of the reproducibility standard deviation to 
the repeatability standard deviation {af^ja^) 

A Laboratory bias 

A 

A Estimate of A 

6 Bias of the measurement method 

A 

6 Estimate of S 

-X Detectable difference between two laboratory 
biases or the biases of two measurement 
methods 

/i True value or accepted reference value of a test 
property 

V Number of degrees of freedom 

g Detectable ratio between the repeatability stan- 
dard deviations of method B and method A 

a True value of a standard deviation 

T Component in a test result representing the 
variation due to time since last calibration 

(/> Detectable ratio between the square roots of 
the between-laboratory mean squares of 
method B and method A 

Xp(v) />-quantile of the x^-distribution with v degrees 
of freedom 



Symbols used as subscripts 



C 
E 
/ 



L 

m 

M 



P 

r 

R 

T 

W 

1. 2. 3.. 



Calibration-different 

Equipment-different 

Identifier for a particular laboratory 

Identifier for intermediate measures of 
precision; in brackets, identification of 
the type of intermediate situation 

Identifier for a particular level 
(ISO 5725-2). 

Identifier for a group of tests or for a 
factor (ISO 5725-3) 

Identifier for a particular test result in a 
laboratory J at level y 

Between-laboratory (interlaboraton/) 

Identifier for detectable bias 

Between-test-sample 

Operator-different 

Probability 

Repeatability 

Reproducibility 

Time-different 

Within-laboratory (intralaboratory) 

For test results, numbering in the order 
of obtaining them 



(1), (2), (3),.. For test results, numbering in the order 
of increasing magnitude 
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Annex B 

(normative) 

Analysis of variance for fully-nested experiments 

The analysis of variance described in this annex has to be carried out separately for each level of the test included 
in the interlaboratory experinnent. For simplicity, a subscript indicating the level of the test has not been suffixed 
to the data. It should be noted that the subscript j is used in this part of ISO 5725 for factor 1 (factor being the 
laboratory), while in the other parts of ISO 5725 it is used for the level of the test. 

The methods described in subclause 7.3 of ISO 5725-2:1994 should be applied to check the data for consistency 
and outliers. With the designs described in this annex, the exact analysis of the data is very complicated when 
some of the test results from a laboratory are missing. If it is decided that some of the test results from a lab- 
oraton/ are stragglers or outliers and should be excluded from the analysis, then it is recommended that all the 
data from that laboratory (at the level affected) should be excluded from the analysis. 



B.I Three-factor fully-nested experiment 

The data obtained in the experiment are denoted by >'y^, and the mean values and ranges are as follows: 

/* 

^//•(i) = l^yi " ^yzl ^/(2) = R'1 - y-ii 

where p is the number of laboratories which have participated in the interlaboratory experiment. 

The total sum of squares, SST, can be subdivided as 

SST = X X ^(y^ - yf = SSO + SS1 + SSe 

/ j k 

where 



ss°=ZZZ(^-?)'='^Z(^-^)'=^Z(>^)'-'^^(^)' 



'■ j k 



SSI = E Z Z(^^ - y^' = 2 j^ Z^« - y^" = Y.<^) 



sse=ZZZ(3v*-^)'=iZZ^^ 



1 j k I 7 



Since the degrees of freedom for the sums of squares SSO, SSI and SSe are p - 1, p and 2p, respectively, the 
ANOVA table is composed as shown in table B.I . 
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Table B.I — ANOVA table for a three-factor fully-nested experiment 



Source 


Sum of 
squares 


Degrees of 
freedom 


Mean square 


Expected mean square 



1 
Residual 


sso 

SSI 
SSe 


p-1 

P 

2p 


MSO-SSO/tp-l) 
MS1 -SS1/P 
MSe = SSe/(2p) 


2 t o 2 

Or + 2apj 


Total 


SST 


4p-l 







The unbiased estimates s^^y s^-^^ and s^ of a^^y a^j and a^, respectively, can be obtaineei from the nnean squares 
MS0/MS1 and MSe as 

4)-^(MS0-MS1) 
^2^=X(MSi -MSe) 

s^ - MSe 

The estinaates of the repeatability variance, one-factor-different internnediate precision variance and reproducibility 
variance are. respectively, as follows: 



2 2 2 

2 2 2 2 

Sfi=-S, +^(1) +5(0) 



B.2 Four-factor fully-nested experiment 

The data obtained in the experinnent are denoted by y^jf^, and nnean values and ranges are as follows: 

% = y (^yiti + %2) W//it(i) = l%i - %2l 



?/ = y (^-1 + ?/2) 



^i(3) = l>'/1-X-2l 



-iZy^ 



whiere p is the nunnber of laboratories which have participated in the interiaboratory experiment. 
The total sum of squares, SST, can be subdivided as follows: 



SST = X S S ^^Uki - yf = SSO + SSI + SS2 + SSe 



i j k i 



where 



sso = X Z Z H^i-y)' = ^T.^if-^pG)' 



i j k I 
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i j k I i 7 / 

i } k I i j k 

s=^ - 1 1 Z Z*'* - %)' - i Z Z Z"* 



' J 



2 

%0) 



i j k I 



i J k 



Since the degrees of freedom for the sums of squares SSO, SSI . SS2 and SSe are p - 1 , p, 2p and 4p, respectively, 
the ANOVA table is composed as shown in table B.2, 

Table B.2 — ANOVA table for a four-factor fully-nested experiment 



Source 


Sum of 
squares 


Degrees of 
freedom 


Mean square 


Expected mean square 



1 
2 
Residual 


SSO 
SSI 
SS2 
SSe 


p-^ 
p 

2p 
Ap 


MS0 = SS0/(p-1) 
MSI =SS1/p 
MS2 = SS2/(2p) 
MSe = SSe/(4p) 


a] + 24) + 4^) + Sfffo) 
a] + 2a^2) + 4(r^,) 
<jI + 24, 


Total 


SST 


8p-1 







The unbiased estimates 5^0). ^o). 4) ^^^ ^r of (tL, gL, aL and a^, respectively, can be obtained from the mean 
squares MSO, MSI, MS2 and MSe as follows: 

4)=y(MS0-MS1) 
5fi)^^(MS2-MS1) 

4)=y ^^^^ -MSe) 
s^ = MSe 

The estimates of the repeatability variance, one-factor-different intermediate precision variance, two-factors dif- 
ferent intermediate precision variance and reproducibility variance are, respectively, as follows: 



2 _ 2 , 2 

2 _ 2 2 2 

2 2 2 2 2 
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Annex C 

(normative) 

Analysis of variance for staggered-nested experiments 

The analysis of variance described in this annex has to be carried out separately for each level of the test included 
in the interlaboratory experinnent. For sinnplicity, a subscript indicating the level of the test has not been suffixed 
to the data, it should be noted that the subscript y is used in this part of ISO 5725 for the replications within the 
laboratory, while in the other parts of ISO 5725 it is used for the level of the test. 

The nnethods described in subclause 7.3 of ISO 5725-2:1994 should be applied to check the data for consistency 
and outliers. With the designs described in this annex, the exact analysis of the data is very complicated when 
Sonne of the test results from a laboratory are missing. If it is decided that some of the test results from a lab- 
oraton/ are stragglers or outliers and should be excluded from the analysis, then it is recommended that all the 
data from that laboratory (at the level affected) should be excluded from the analysis. 

C.I Three-factor staggered-nested experiment 

The data obtained in the experiment within laboratory / are denoted by y^ (/ = 1, 2, 3), and the mean values and 
ranges are as follows: 

yi{2) "= y (yn + yi2 + yi3) ^i{2) == l^((i) - >'/3l 

i 

where p is the number of laboratories which have participated in the interlaboratory experiment. 
The total sum of squares, SST, can be subdivided as follows: 



SST = 2] ^(jy-3')^ = SS0 + SS1 +SSe 



I J 



where 

SS0 = 32](X(2))'-3/>(?)' 



SSI = IX-' 



(2) 



SSe^l^w; 



2^-."^^) 



Since the degrees of freedom for the sums of squares SSO, SSI and SSe are p—^.p and p, respectively, the 
ANOVA table is composed as shown in tabled. 
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Table C.I — ANOVA table for a three-factor staggered-nested experiment 



Source 


Sum of 
squares 


Degrees of 
freedom 


Mean square 


Expected mean square 



1 
Residual 


sso 

SSI 
SSe 


P 
P 


SS0/(p-1) 

SS1/P 

SSelp 


2,5 2 , o 2 


Total 


SST 


3p-1 







The unbiased estimates s^^y j^ij and s^ of ctjo)- "^(i) ^nd a^, respectively, can be obtained from the mean squares 
MSO, MSI and MSe as follows: 

s\q^ = -^ MSO - ^ MSI + 4r MSe 



12 



12 



4)=^ MSI --I MSe 



sf = MSe 

The estimates of the repeatability variance, one-factor-different intermediate precision variance and reproducibility 
variance are, respectively, as follows: 



2 _ 2 . 2 

■^l(l) —^r+ ^(1) 
2 2,2,2 



C.2 Four-factor staggered-nested experiment 

The data obtained in the experiment within laboratory i are denoted by y^ (/ = 1, 2, 3, 4), and the mean values and 
ranges are as follows: 



1 



w,(i) = b'/i-3',-2l 
w.(2) = R(i) - yisi 

'^,•(3) = 1^(2) - ^mI 



3^(i)=y0'n+3',-2) 

yi{2) = ^b>n+ya+yi3) 
^(3) = -^ (^'-1 + ya + yi3 + yiA) 

where p is the number of faboratories which have participated in the interlaboratory experiment. 
The ANOVA table is composed as shown in table C.2. 



16 



IS 15393 (Part 3): 2003 
ISO 5725-3 : 1994 



Table C.2 — ANOVA table for a four-factor staggered-nested experiment 



Source 


Sum of squares 


Degrees of 
freedom 


Mean square 


Expected mean square 



1 
2 
Residual 


1 ^ 2 

ySH'.d, 


p~^ 
p 
p 
p 


SS0/{p-1) 
SSI//? 
SS2//7 
SSelp 


2 3 2 5 2 2 
^2.72 ^32 

^r+y^(2) 
4 


Total 


I J 


4p-1 







C.3 Five^factor staggered-nested experiment 

The data obtained in the experiment within laboratory / are denoted by y^ (/ = 1, 2, 3, 4, 5), and the mean values 
and ranges are as follows: 



X(i)=y ()',i+y.-2) 

y/(3) = -J (y.i + ya + yi3 + y^) 

_ -I 

X(4) = -g- tei + ya + fe + ya + Viz) 



Wii^) = \yn - yi2\ 
^i{2) = K(i) - ya\ 
M'/(3) = R(2) - >V4l 

W/(4) = ly,(3)-)',-5l 



fZ» 



(4) 



where p is the number of laboratories which have participated in the interlaboratory experinnent. 
The ANOVA table is composed as shown in table C.3. 

Table C.3 — ANOVA table for a five-factor staggered-nested experiment 



Source 


Sum of squares 


Degrees of 
freedom 


Mean square 


Expected mean square 



1 
2 
3 
Residual 


|z:-i?2) 


p-1 

P 

P 

P 

P 


SS0/(p-1) 

SSl/p 

SS2/P 

SS3/P 

SSe/p 


t2 1 7 2 , 11 2 , 17 2 , c 2. 

^2 . 11 .2 . 13 ,2 , 8 _2 

^r+ ^Q ^^(3)+ ^Q ^(2)+ 5 ^(1) 

'^r+y<^(3)+yC^(2) 
<^r+yff(3) 


Total 


lliyij-yf 


5p-1 
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C.4 Six-factor staggered-nested experiment 



The data obtained in the experiment within laboratory i are denoted by y^ (/ = 1, 2, 3, 4, 5, 6), and the mean values 
and ranges are as follows: 



yi[2) = y (y/1 + ya + yai 
y/O) = \ (Xi + Ja + ya + 3V4) 



»*'.(i) = \yn - ya\ 
w,(2) = %c\) - yd 

^i(2) = R{2) - 3V4I 
W,{4) = R(3) - y/51 

♦^,(6) = IX(4) - X-el 



-^Y^> 



(5) 



where p is the number of laboratories which have participated in the interlaboratory experinnent. 
The ANOVA table is connposed as shown in table C.4. 

Table C.4 — ANOVA table for a six-factor staggered-nested experiment 



Source 


Sum of squares 


Degrees of 
freedom 


Mean square 


Expected mean square 



1 
2 
3 
4 
Residual 


i 


p 
p 
p 
p 

p 


sso|ip~^) 
SS1//7 

SS2JP 
SS3IP 
SS4/P 
SSe/p 


2.4 2 .o2 ,o2 ,13 2 ,£j2 
^r + 3 (^(4) + 2(Tp) + 3<r(2) + 3 <T(ij + b<T(0) 

^2 . 16 2 . 6 2 . 7 2 . 5 2 
2 , 11 2 13 2 , 8 2 

^ 10 *^> 10 ''^3)+ 5 ^^(2) 

'^r+-Q-«^(4)+-2-^(3) 


Total 




6p-1 
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Annex D 

(informative) 

Examples of the statistical analysis of intermediate precision experiments 



D.I Example 1 — Obtaining the [time + 
operator]-different internnediate precision 
standard deviation, s^^jq^ within a specific 
laboratory at a particular level of the test 



D.1.1 Background 

a) Measurement met'hod: Determination of the 
carbon content in steel by vacuum emission 
spectrometry with test results expressed as per- 
centages by mass. 

b) Source: Routine report of a steel works in Nov- 
ember 1984. 

c) Experimental design: In a specific laboratory, a 
randomly selected sample out of the materials 
analysed on one day was analysed again on the 
next day by a different analyst, in a month 29 pairs 
of such data were obtained (see table D.I). 



D.I. 2 Analysis 

The data yj-^, y^^ and vv,- = 1}'^^ - }?^2l S''® shown in 
table D.I. The analysis follows the procedure given in 
8.2. 

A plot of the data [deviations from the mean of the 
measurements on both days Ky^^ - y) versus the 
sample number y] is shown in figure D.I. This plot and 
the application of Cochran's test indicate that the 
ranges for samples with numbers 20 and 24 are 
outliers. There is a large discrepancy between the 
daily measurements on these samples which is most 
likely due to errors in recording the data. The values 
for these two samples were removed from the com- 
putation of the [time + operator]-different intermedi- 
ate precision standard deviation, ^^jo)* which is 
calculated according to equation (12) as 



^'f^°) = jT727&'=2'87-io"' 



Table D.I — Original data — Carbon content, % (m/m) 



Sample 
No. 


First day 


Next day 


Range 


7 


>'yi 


ya 


Wy 


1 


0,130 


0.127 


0,003 


2 


0,140 


0.132 


0,008 


3 


0,078 


0,080 


0.002 


4 


0,110 


0.113 


0,003 


5 


0,126 


0,128 


0,002 


6 


0.036 


0,032 


0.004 


7 


0,050 


0.047 


0.003 


8 


0,143 


0.140 


0,003 


9 


0,091 


0,089 


0,002 


10 


0,040 


0,030 


0.010 


11 


0,110 


0.113 


0,003 


12 


0,142 


0,145 


0.003 


13 


0,U3 


0.150 


0,007 


14 


0,169 


0.165 


0,004 


15 


0,169 


0,173 


0.004 



Sample 
No. 


First day 


Next day 


Range 


J 


3-/1 


yj2 


"i 


16 


0,149 


0,144 


0,005 


17 


0,044 


0,044 


0.000 


18 


0,127 


0,122 


0,005 


19 


0,050 


0,048 


0,002 


20 


0,042 


0,146 


0,104 


21 


0,150 


0,145 


0,005 


22 


0,135 


0,133 


0,002 


23 


0,044 


0,045 


0,001 


24 


0,100 


0,161 


0,061 


25 


0,132 


0,131 


0,001 


26 


0,047 


0,045 


0,002 


27 


0,168 


0,165 


0,003 


28 


0,092 


0,088 


0,004 


29 


0,041 


0,043 


0,002 
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Figure D.I — Carbon content in steel — Deviations from the mean of the measurements on both days 

versus the sample number 



D.2 Example 2 — Obtaining the 
time-different intermediate precision 
standard deviation by interlaboratory 
experiment 

D.2.1 Background 

a) Measurement method: Determination of the 
vanadiunn content in steel by the atomic absorp- 
tion spectrometric method described in the in- 
structions for the experiment. Test results are 
expressed as percentages by mass. 



b) Source: IS0/TC17, Steel|SC^. Methods of de- 
termination of chemical composition. Experiment 
carried out in May 1985. 

c) Experimental design: A three-factor staggered- 
nested experiment was carried out with 20 lab- 
oratories each reporting two test results obtained 
under repeatability conditions on one day, fol- 
lowed by one further test result on the next day 
at each of the six levels included in the exper- 
iment. All measurements in any laboratory were 
carried out by one operator, using the same 
measurement equipment. 



20 



IS 15393 (Part 3) : 2003 
ISO 5725-3 : 1994 



D.2.2 Analysis 

The data for all six levels are given in table D.2. 

The analysis of variance is presented for only one of 
the levels, -.e. level 1. 

A plot of the data (test results for day 1 and day 2 
versus laboratory nunnber /) is shown in figure D. 2. 
Thts plot indicates that laboratory 20 is an outlier lab- 



oraton/. There is a large discrepancy between the test 
result for day 2 and the nnean value for dayl, which 
is very large connpared with the test results for the 
other laboratories. This laboratory was rennoved from 
the -Calculations of the precision nneasures- 



tn accordance with C.1 of annex C, w^^^, w,-f2) ^^^ 
yff2) were connputed and the results are shown in ta- 
ble D.3. 



150 



X UO 

i 

^ 130 
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110 



100 



90 



80 



n Day X first test result 
-h Day 1. second test result 
* Day 2 



-ffi- 



D 



-^ — h 



* 



* 



D 



+ 



D 



D 



-©- 
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[] 



D ■» 



D + 



-h 
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-f- 
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14 8 12 16 20 
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Figure D.2 — Vanadium content in steel — Test results for day 1 and 2 at level 1 versus laboratory number 
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Laboratory 
No. 


Level 1 (0,01 %) 


Level 2 (0.04 %) 


Level 3 (0. 


1 %) 


Level 4 (0.2 %) 


Level 5 (0.5 %) 


Levels (0,75%) 


Dayl 


Day 2 


Dayl 


Day 2 


Dayl 


Day 2 


Dayl 


Day 2 


Dayl 


Day 2 


Dayl 


Day 2 


yn 


ya 


>/3 


yn 


yi2 


yiz 


yn 


yi2 


yi3 


yn 


ya 


yi3 


yn 


yi2 


yi3 


yn 


yi2 


yi3 


1 


0.009 1 


0.010 2 


0.009 8 


0.038 2 


0.D38 8 


0.038 5 


0,101 


0,103 


0,102 


0,214 


0,211 


0.210 


0.514 


0.510 


0,513 


0,755 


0.753 


0,751 


2 


0,010 


0,010 


0,009 


0,041 


0,041 


0.039 


0.111 


0,111 


0,108 


0.220 


0,220 


0,215 


0,520 


0.540 


0,540 


0,800 


0.755 


0,750 


3 


0,009 5 


0,009 


0,009 4 


0.039 


0.038 


0,037 


0,108 


0,110 


0.107 


0,213 


0,215 


0,215 


0,500 


0,514 


0.504 


0.738 


0,730 


0,724 


4 


0,008 


0,008 3 


0,007 7 


0.037 4 


0,036 1 


0.038 2 


0.109 


0.106 


0,104 


0.214 


0,222 


0,201 


0.519 


0,518 


0,518 


0,744 


0.742 


0,732 


5 


0,010 


0.010 


0,010 


0.035 


0,037 


0,037 


0,103 


0,103 


0,110 


0,210 


0,210 


0,205 


0,495 


0,500 


0,512 


0,743 


0.753 


0.750 


6 


0.008 9 


0,009 4 


0,009 4 


0,036 8 


0,036 8 


0,037 7 


0.106 


0,106 


0,108 


0,232 


0,240 


0.221 


0.526 


0,532 


0.513 


0.733 


0,740 


0.746 


7 


0,009 8 


0,009 9 


0.010 1 


0,037 6 


0,038 


0,038 4 


0,107 


0,105 


0.108 


0,215 


0.215 


0,216 


0.521 


0,519 


0,526 


0,754 


0.756 


0,756 


8 


0,009 6 


0.009 4 


o.obg 9 


0,037 9 


0,036 6 


0.037 9 


0.108 


0,107 


0.108 


0.193 


0,195 


0.210 


0.507 


0,493 


0.511 


0.732 


0,729 


0,732 


9 


0,010 4 


0,009 4 


0,010 


0.036 5 


0,037 


0.036 7 


0,104 


0,106 


0,105 


0,211 


0.205 


0,213 


0.509 


0.515 


0,515 


0,734 


0.738 


0.747 


10 


0.010 7 


0,011 8 


0,009 7 


0,037 


0.037 5 


0.038 


0.105 


0.110 


0,105 


0,210 


0,220 


0,225 


d.520 


0,520 


0.525 


0.760 


0,760 


0,765 


11 


0,010 


0,010 


0.009 


0.038 


0,038 


0,037 5 


0,102 


0,102 


0,102 


0,213 


0.211 


0.214 


0.513 


0.516 


0,514 


0,746 


0,748 


0.746 


12 


0,010 9 


0,011 5 


0,009 7 


0.039 


0,039 


0.039 


0.101 


0,108 


0,105 


0,208 


0,215 


0,210 


0,509 


0.528 


0.510 


0.758 


0,748 


0,750 


13 


0,010 


0.009 5 


0,009 5 


0,037 5 


0,037 5 


0,037 5 


0,103 


0.104 


0.108 


0,212 


0.222 


0,215 


0.510 


0.520 


0,505 


0,735 


0.755 


0.750 


14 


0,009 6 


0,009 6 


0,010 


0.037 4 


0,037 4 


0,038 9 


0,104 


0.106 


0,110 


0.218 


0,218 


0,212 


0,520 


0,528 


0.522 


0.740 


0.735 


0.742 


15 


0,009 9 


0,009 1 


0,008 2 


0,038 1 


0,037 5 


0,039 2 


0,109 


0,106 


0.107 


0,214 


0.210 


0.211 


0,510 


0.510 


0.515 


0,749 


0,729 


0,744 


16 


0.009 8 


0,010 


0.009 5 


0.037 3 


0.037 7 


0.039 7 


0.105 


0,105 


0,104 


0.215 


0,212 


0,218 


0,519 


0,517 


0,531 


0,754 


0.751 


0.759 


17 


0,010 5 


0,010 2 


0,01 1 2 


0,038 9 


0,038 2 


0.037 3 


0.107 


0,108 


0,104 


0,214 


0.210 


0,209 


0.517 


0.515 


0,514 


0.735 


0,728 


0,741 


18 


0.010 3 


0,010 5 


0,011 8 


0,038 2 


0.038 


0,037 4 


0,103 


0,104 


0.103 


0.224 


0,218 


0,217 


0.515 


0,514 


0,517 


0,788 


0,798 


0.787 


19 


0.009 8 


0,009 6 


0,010 4 


0,038 3 


0,037 5 


0,036 6 


0,110 


0,109 


0,104 


0,217 


0,215 


0.215 


0.530 


0.525 


0.520 


0,755 


0.745 


0,740 


. 20 


0,014 


0.014 


0,010 


0,037 


0,040 8 


0.036 9 


0.104 


0.106 


0,107 


0.214 


0.214 


0.203 


0,518 


0.518 


0,481 


0,730 


0,737 


0,658 
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1 auiv L 


/,o VCIiUC 


'^»^^i0y^i{2 


) a"« yi{2) 


Laboratory 








No. 


H^l(l) 


^i[2) 


3^(2) 


1 


0,001 1 


0,000 15 


0,009 700 


2 


0.000 


0.001 00 


0,009 667 


3 


0,000 5 


0,000 15 


0.009 300 


4 


0,000 3 


0,000 45 


0.008 000 


5 


0,000 


0,000 00 


0,010 000 


6 


0,000 5 


0,000 25 


0,009 233 


7 


0,000 1 


0,000 25 


0.009 933 


8 


0.000 2 


0,000 40 


0.009 633 


9 


0,001 


0.000 10 


0,009 933 


10 


0,001 1 


0,001 55 


0,010 733 


11 


0,000 


0,001 00 


0.009 667 


12 


0.000 6 


0,001 50 


0,010 700 


13 


0,000 5 


0,000 25 


0,009 667 


14 


0,000 


0,000 40 


0,009 733 


15 


0.000 8 


0.001 30 


0,009 067 


16 


0,000 2 


0,000 40 


0.009 767 


17 


0,000 3 


0.000 85 


0.010 633 


18 


0,000 2 


0,001 40 


0,010 867 


19 


0,000 2 


0,000 70 


0,009 933 



The sums of squares of Wy^ij, w^^j) ^nd yi^2) ^^^ ^^e 
mean vaiue y are computed as 



^-6 



^4^ = 5.52x10 
5](5^.(2))' = 1832.16x10 



'=lV&2) = 0,009 798 25 



From these values, the sums of squares SSO, SSI and 
SSe are obtained, and the ANOVA table is prepared 
as shown in table D.4. 

The unbiased estimates of variances between labora- 
tories sfpy between days within a laboratory sf^y and 
the estimated repeatability variance sf are obtained 
as 

4) = 0.278 X 10""® 
jpj = 0.218 X 10~® 
5,^ = 0.145 X 10~® 



The reproducibility standard deviation 5/j. time- 
different intermediate precision star»dard deviation 
s^(jy and repeatability standard deviation s, are ob- 
tained as 

^R = V ^r^ + 5p) + sfo) = 0.801 X 10~^ 



=v^ 



^i(T) ^Sj sf^ 5(^ij = 0.603 X 10" ^ 



Sr^ysf =0, 



-3 



381 x10 



The values of these standard deviations for the six 
levels of vanadium content are summarized in 
table D. 5 and shown in figure D.3. 



Table D.4 — ANOVA table — Vanadium content 



Source 


Sum of 
squares 


Degrees of 
freedom 


Mean 
square 


Expected mean square 


(laboratory) 

1 (day) 
Residual 


24,16x10"® 
8,29x10"® 
2,76 xlQ-® 


18 
19 
19 


1.342 x 10"® 
0,436 X 10"® 
0,145 X 10"® 




Total 


35.21 xlO"® 


56 
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Table D.5 — Values of v ^i(t) ^"d ^r '<*■* ^'^ levels of vanadium content in steel 



Level 


Outlier 

laboratories 

No. 


Average (%) 


Sr (%) 


^HT) (%) 


Sr (%) 


1 


20 


0.009 8 


0,381 xlO"^ 


0.603 X 10"^ 


0.801 X 10"^ 


2 


2 


0,037 8 


0.820x10"^ 


0.902x10"^ 


0.954x10"^ 


3 


— 


0,105 9 


1,739 X 10"^ 


2.305x10"^ 


2.650x10"^ 


4 


6 and 8 


0.213 8 


3,524 X 10"^ 


4,710 X 10"^ 


4.826 X 10~^ 


5 


20 


0.516 4 


6.237x10"^ 


6,436x10"^ 


9,412x10"^ 


6 


20 


0.748 4 


9.545 X 10"^ 


9,545x10"^ 


15.962 X 10"^ 
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Figure D.3 — Vanadium content in steel — Repeatability standard deviation s^, time-different interm^iate 
precision standard deviation 5)^^ and reproducibility standard deviation 5/^ as functions of the concentrattpn 

level 
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